Datalicious Depths of Delectable Data

Want to jump to a specific question?

Which results are the most common?

See, if Open Psychometrics recorded the respondents’ results, it would be quite quick to answer this question. Unfortunately, they didn’t, and we’re working with a bunch of numbers!

This is what the data looks like:

I’ve selected the first 6 columns.. and it’s not too bad! It’s a little intimidating to think that there are over 1 million more rows, but we’ve gotta start somewhere >:)

We start by calculating the scores for the ‘Extroversion’ personality trait. We can do this by summing up the scores of the 10 EXT (standing for EXTroversion) questions. However, it should be noted that answering a ‘4’ or ‘5’ on a EXT question doesn’t always mean that a user is more extroverted. For example, answering 5 for “I don’t talk a lot” vs “I am the life of the party” would significantly affect your results.

So, we’ll need to make sure to add and subtract scores as necessary, depending on how the questions are keyed. I’ve arbitrarily made the decision to ‘positively key’ questions symbolising extroversion (meaning that I’d add points to their total score if they showed signs of extroversion), and ‘negatively key’ questions symbolising introversion (subtracting points from total score). See the table below to better understand this keying:

Table 1: EXT Question Key
Questions Key
I am the life of the party. \(+\)
I don’t talk a lot. \(-\)
I feel comfortable around people. \(+\)
I keep in the background. \(-\)
I start conversations. \(+\)
I have little to say. \(-\)
I talk to a lot of different people at parties. \(+\)
I don’t like to draw attention to myself. \(-\)
I don’t mind being the center of attention. \(+\)
I am quiet around strangers. \(-\)

Hence, after adding/subtracting their points from each question, any positive total score (> 0) will mean that the user receives an ‘S’ for Sociable, while a negative score (< 0) would result in an ‘R’.1 If their score is 0, then they’d receive an ‘X’, as their results since they’re perfectly in-between, and will remain inconclusive.

Below is a sample table of results, where extletter (their final letter result) and extscore (the sum of their points) are calculated from the raw data.


We can also visualize our results into a graph:

The same processes will be applied to the other personality traits, with their graphs located below:

Now, we can combine everybody’s letters from each personality traits to form their final result, then determine which results are the most common within this data set.

In fact, we can see the 25 most common results below:


WOOO! Congratulations to the XXOAI family for being among the most common result out of 243 possibilities!

If you’d prefer to see a more numerical representation, I’ve provided a table with the exact number of each result and the average score of each personality trait2:

Table 2: The 10 Most Common Results
Results Amount of Responses Percentage of People
SCOAI 159575 15.716379
RLOAI 121251 11.941888
SLOAI 100841 9.931727
RCOAI 92548 9.114958
RLUAI 70642 6.957459
SLUAI 56870 5.601068
SCUAI 41138 4.051640
RCUAI 26379 2.598041
RLOEI 23547 2.319120
RCOEI 22333 2.199554
Table 3: Average Score for Each Personliaty Trait
Extroversion Neuroticism Conscientiousness Agreeableness Openness
avgscore 0.24 -0.6533333 3.88 8.066667 8.133333

Let’s try to analyze why these results happened.

Extrovertism

Extrovertism is the most balanced trait, as there seems to be a nice mix of S(ocial) and R(eserved) – representative of the larger population. I’d assume this is because questions in this trait were very straight-forward (e.g. “I start conversations”), and users likely display/are conscious of these behaviors in their everyday life. Hence, with a more ‘objective’ viewpoint, this removes the issue of self-bias and leads to more accurate results.

There are also about ~40k more introverts compared to extroverts. Maybe the S’s aren’t as likely to spend 20 minutes on an online test, compared to R’s?

Neuroticism

Once again, a solid distribution of results between C(alm) and L(imbic), mirroring what I’d expect the general population to be like. Similar to the extrovertism section, the questions tend to be straightforward and there’s relatively less self-bias within the trait, as many people are conscious of their emotions, and whether or not they control them.

There are ~60000 more limbic people compared to calm. I’m not really surprised - people are more stressed3 and more sad4 than we’ve ever been. Furthermore, emotional regulation is a result of introspection and reflection. As our society slowly moves towards constant stimulation and excess, it’s no wonder we struggle to achieve emotional stability.

Conscientiousness, Agreeableness, and Openness

With these three traits, we start to see a much larger gap between the possible letters. There are significantly more people that are organized, agreeable, and inquisitive, relative to unstructured, egocentric, and non-inquisitive.

I definitely don’t think these results reflect the general population, despite the fact that I have no evidence stating so. If I had to speculate, I’d say that this data is just a tiny bit biased, leading to skewed results.

  1. We’re just a little bit tainted

No matter how hard we try, we can never be completely objective. Many struggle to see things beyond ourselves, to judge every action we take from a neutral standpoint.

In normal, everyday life, this is not too significant of an issue. A little bit of subjectivity never hurt anybody! However, when we’re trying to objectively analyze and record data about ourselves, since this is a self-administered quiz, our lack of objectivity can lead to delusional answers.

  1. We’re fragile creatures

For these three categories, there are clear ‘winners’. In this society, it is almost ALWAYS better if you’re organized, agreeable, and inquisitive, rather than the opposite. In fact, it’s almost an insult if we AREN’T these things, because that means we should ‘be better’.5 For example, you may want to be agreeable and people-pleasing, since it shows that you’re friendly and nice, and people will tend to ‘like’ you more, instead of if you’re confrontational and assertive for your own needs. Or, as our society moves towards maximizing productivity and ‘grind culture’, you NEED to be conscientious and self-disciplined, or else you won’t be successful. Or, people don’t want to be seen as rigid and unwilling to try new things. Society will call them scaredy-cats, boring, or that you’re ‘bringing the mood down’.

It doesn’t help that we don’t like being ‘bad people’ – we constantly attempt to justify our actions to be good and perceive ourselves in a positive light. We are rarely the villains in our own stories; it’s always the other person doing something wrong, or doing something worse than we did, or they started the ordeal.

However, when we can’t be objective, we can confuse what we actually do, to what we wish we did. This is going to lead us to choose answers corresponding to those ‘better’ traits of self-discipline, agreeableness and inquisitiveness, instead of objectively saying we have the ‘worse’ traits of unstructuredness, egocentrism and un-inquisitiveness.

  1. We’re just built for this (for Openness)

There’s also the classic case of sampling bias. The people who take this quiz are probably curious about psychology, want to know more about themselves, and are willing to try something new. These are typically the types of people who are inquisitive (matching with the I letter) instead of non-inquisitive (matching with the N letter).

Sheer Statistical Impossibility…?

However, When analyzing this data, it seems.. strange that so many __OAI types are represented. In fact, it feels weird that 15%(!!!!) of people were the EXACT SAME TYPE, despite ALL POSSIBLE COMBINATIONS!

So, let’s see how it compares to the theoretical data. Using the data6 from SimilarMinds, we can see how our data stacks up.

Table 4: Theoretical Data
Results Percentage of People
SCOAI 3.4
RLOAI 2.7
SLOAI 2.5
RCOAI 3.5
RLUAI N/A
SLUAI 3.4
SCUAI 4.1
RCUAI N/A
RLOEI N/A
RCOEI N/A
Table 4: Experimental Data
Results Percentage of People
SCOAI 15.716379
RLOAI 11.941888
SLOAI 9.931727
RCOAI 9.114958
RLUAI 6.957459
SLUAI 5.601068
SCUAI 4.051640
RCUAI 2.598041
RLOEI 2.319120
RCOEI 2.199554

Looking at these tables, there’s a clear discrepancy between theoretical and experimental data, where none of the theoretical results really match up to what is seen in our data set – certain results are far more represented than the average value.

However, most of it can be explained by the previous analysis: Wrong results might occur because of biases and societal norms (cementing the last two letters to be A and I), in addition to the natural disposition of respondents.

Honestly, I’m not too sure why 15% of people are SCOAI, maybe people are being influenced to answer what they WANT to be like, rather than what they actually are, since SCOAI seems like one of the most ‘socially-successful’ results.7 So, in reality, I think that many respondents are not actually SCOAIs. That’s my best guess!8

Also, just to provide a comphrensive review of the results, here’s a list of the most uncommon ones!

Table 5: Most Uncommon Results
Results Amount of Responses
XXUXN 3
SXXXN 5
XLXXN 5
XXUEX 5
SCXXX 6
XCXEX 6
XXOXN 7
SXOXX 9
XCUXX 9
XCXXN 9

No surprise, it’s a lot of results with X’s!

At first, I was surprised that ‘XXXXX’ didn’t appear, since I’d assume it (theoretically) is the most unlikely.9 However, I wouldn’t be surprised if only 5% of respondents were genuinely XXXXX, while the other 95% of people who got the result just kept clicking 3 (Neutral) for every question, or had some kind of game to see if they could get the (theoretically) super rare XXXXX.

Do results vary between countries?

This data contains 224 unique ISO country codes10. Let’s dig through this data - a fun bit of stalking!

We can see that the majority of data came from the US, with a whopping total of 546403 respondents. Trailing (very far) behind, we also have Great Britain (GB), Canada (CA), and Australia (AU).

This is likely because this quiz is in English, and will generally cater towards countries with English as their primary language. In addition, Google’s SEO (Search Engine Optimization) is also affected by location, and can rank websites by their proximity to the user.11 So, it’s possible that Open Psychometrics is American12, and when Americans search up “Big Five Personality Test”, this would be the first quiz that shows up.13

But, we’re not really concerned on WHERE people are taking the quiz. Instead, we only care about how it affects the responses. Hence, we’re going to start by finding the most common results for America, Great Britain, Australia, and the Philippians –these location shave the most amount of results while being from different continents– and seeing how they compare to one another.

Table 6: America
Results Percentage
SCOAI 16.855325
RLOAI 12.283425
SLOAI 10.141050
RCOAI 9.943943
RLUAI 6.578112
SLUAI 5.344041
SCUAI 4.044268
RCUAI 2.546472
RCOEI 2.150610
RLOEI 2.142924
Table 6: Great Britian
Results Percentage
SCOAI 13.129918
RLOAI 11.623821
SLOAI 10.149258
RLUAI 8.353355
SLUAI 7.272208
RCOAI 6.776683
SCUAI 4.606883
RLOEI 2.660820
RCUAI 2.575230
RLUEI 2.386029
Table 6: Australia
Results Percentage
SCOAI 16.546072
RLOAI 11.279233
SLOAI 9.696182
RCOAI 9.020588
RLUAI 6.534080
SLUAI 5.954427
SCUAI 4.309414
RCUAI 2.372577
RLOEI 2.072756
RCOEI 2.046772
Table 6: Philippines
Results Percentage
RLOAI 15.105557
SCOAI 11.699501
SLOAI 10.540636
RCOAI 8.726760
RLUAI 5.869905
SLUAI 3.305285
RLOEI 2.216960
RLOAN 2.191767
XLOAI 1.889454
RCUAI 1.627450

From the above table, it’s pretty clear that countries have very similar trends, with the top 7 result virtually the same between all countries. However, there are slight differences you can take out of it:

Let’s try zooming out by plotting the averages on a world map, and then analyzing results.

A note on the data: Locations with less than 10 responses have been omitted from the data, as they often significantly skewed maps. This removed 58 locations off the map, with Africa losing a pretty big chunk of their land.

(#fig:extscores world map)Diamond sadasds

Higher scores are correlated with extroversion, lower scores are correlated introversion.

Table 7: Most Extroverted
region ExtScores
Cuba 2.708333
Greenland 2.382353
Rwanda 2.093750
Ethiopia 1.342960
Afghanistan 1.018519
Norway 0.989608
Table 7: Least Extroverted
region ExtScores
St. Kitts & Nevis -6.333333
Sudan -5.466667
St. Lucia -5.190476
Åland Islands -4.733333
Guyana -4.543478
Bhutan -4.500000

There doesn’t seem to be a clear trend in the world, but there seems to be several generalizations.

It’s quite interesting that the sterotype is that Americans are more extroverted and loud, while Asians are more introverted and quiet. Doesn’t seem to apply to this dataset!

Higher scores are correlated with being calm, lower scores are correlated being limbic.

Table 8: Most Calm
region estScores
Suriname 4.697674
Eswatini 3.461539
Ethiopia 3.451264
Cape Verde 3.181818
Cuba 3.000000
Papua New Guinea 2.791667
Table 8: Least Calm
region estScores
Jersey -4.476191
Guernsey -4.044444
Syria -3.875000
Samoa -3.727273
Algeria -3.234310
Belize -3.125000

It seems like the south-eastern part of the world is less limbic, specifically Africa and East Asia. I find it funny that China specifically is seen to be relatively ‘calm’, as they are notorious for bad work-life balances14, the ‘lie down’ movement15 – conditions that would propagate negative moods and emotional instability.

Yet, it’s also reasonable to say that Chinese people are accustomed to high stress when dealing with academic pressures.16 Hence, they might have learned to regulate their emotions.

Higher scores are correlated with organization and contentiousness, lower scores are correlated carelessness.

Table 9: Most Contentious
region csnScores
Ghana 6.922794
Papua New Guinea 6.708333
Grenada 6.291667
Rwanda 6.281250
Uganda 6.127517
Kenya 6.111744
Table 9: Least Contentious
region csnScores
Bhutan -1.0000000
Bolivia 0.0575342
Libya 0.1764706
Angola 0.3571429
Åland Islands 0.6000000
Paraguay 0.6975089

For conscientiousness, Africa is lit up like a Christmas tree! North America is also pretty light. On the other hand, South America is quite dark.

I find it interesting that Asia, which is known for their disciplined schedules and focus, seems to be quite average.

Higher scores are correlated with agreeableness, lower scores are correlated egocentrism.

Table 10: Most Agreeable
region agrScores
Papua New Guinea 11.04167
Rwanda 10.56250
Cameroon 10.45455
St. Lucia 10.42857
Cuba 10.20833
Tanzania 10.17442
Table 10: Least Agreeable
region agrScores
Madagascar 1.500000
Åland Islands 1.533333
Bhutan 3.428571
Poland 3.818162
Cape Verde 3.909091
Belarus 3.927711

I had to double check twice to make sure I didn’t accidentally duplicate the conscientiousness graph, as they look almost identical.

I find it quite interesting that everybody thinks they’re agreeable. When looking at the scores on the ‘least agreeable’ table, not a single country is willing to admit they’re more egotistical! Alas, the bias goes deep.

(#fig:opn world map)Diamond Prices

Higher scores are correlated with inquisition, lower scores are correlated traditionalists.

Table 11: Most Inquisitive
region opnScores
Madagascar 12.50000
Cuba 11.37500
Seychelles 11.36364
St. Lucia 11.04762
Armenia 10.91743
Germany 10.89598
Table 11: Least Inquisitve
region opnScores
Macao SAR China 3.506623
Bhutan 3.642857
Cambodia 3.971429
Malaysia 4.221204
Nepal 4.783489
Gambia 5.300000

The Americas, Africa, and Europe seem to be a lot more open to new experiences, as they’re significantly brighter than the other continents. I can only think that risk-taking is just encouraged inside these societies or people are given more personal freedom and allowed more individuality. However, in other locations, they may prioritize stability and traditional methods – not necessarily a bad thing.

Are All Questions Created Equal?

We can also analyze the questions themselves. A funky little thing that this quiz did, was record how many milliseconds each respondent spent on each question. That seems like a fun thing to look at!

Thus, I present to you: Amount of time spent on each question!

For your reference:

I really liked using a box plot17. to symbolize these results. For those who are unaware,The white box symbolizes the interquartile range, with the lower half of the box represents the bottom 25%, while the top half of the box represents the top 25% of users. The line in the center is the median time taken. Box plots are great for visualizing the spread of data (which seems to range quite a bit).

A note of the data: I’ve removed values above 20 seconds18 and only took a random sample of 500 response times for each question19.

However, I want to be more precise with these loading times, so I’ve specifically pulled the questions that take the longest and shortest times to complete.

Table 12: Questions That Took the Longest
Category Question Time in Seconds
EXT1_E I shirk my duties. 15.46295
CSN6_E I leave my belongings around. 7.44249
CSN8_E I am relaxed most of the time. 7.42881
OPN2_E I feel little concern for others. 7.37643
EST8_E I don’t like to draw attention to myself. 6.76565
Table 12: Questions That Took the Shortest
Category Question Time in Seconds
OPN5_E I use difficult words. 3.56249
CSN9_E I often feel blue. 3.45699
OPN10_E I have excellent ideas. 3.33530
EST10_E I am full of ideas. 3.26817
EST9_E I have a rich vocabulary. 3.23400

LYING!!

I’ve taken the liberty of removing EXT_1 (the first question on the quiz), which had an average score of 87 seconds. This is likely because people people were getting accustomed to the quiz, had loading time issues, or started the quiz, then immediately forgot about it.

“I shirk my duties” took the longest, likely because ‘shirk’ is an uncommon word and people may have searched up thed efintion - increasing the amount of time it took to answer. In addition, questions that look longer often had more words to read and often focused on situation prompts. For example, people are rarely “always relaxed” or “never relaxed”, so it takes time to think whether you’re relaxed a MAJOURITY of the time. Same thing for little concern for others - there are tons of people you care about, but also, tons of people you don’t. So, do you take everybody into consideration? Do you focus more on the people close to you to answer this question? it’s a bit tricky to have an answer at the top of your head for these cases.

On the other hand, the questions that took the least amount of time are short and straightforward, and are obvious to judge yourself on. You either talk pretentiously to seem smart, or you don’t. I do find it interesting that it’s difficult for people to determine whether they’re ‘relaxed’ rather than ‘blue’. Likely because you consciously pay attention to when you’re sad, but not when you’re relaxed? You can also see that these questions are the ones that are asked later (i.e. AGR_9 is part of the 9th out of 10 rounds of questions, more specifically, the 44th question they’ve read). Anticipation for results may have caused them to rush through the later questions.

Another interesting thing to note is the distribution of answers for each question. You may expected that each question has a distribution similar to standard distribution. However, that’s actually not the case! Many questions tend to have a distribution like so:

There are four major types of distribution seen in the data:

  1. Logarithmic (First Row)

The columns progressively increase or decrease. I think these graphs are the most “trustworthy”, as you’d only put 1 or 5 (the extremes) if you were incredibly confident in your answer.20 Not only that, but these questions aren’t really ‘shameful’ to admit, like “I get stressed out easily” is seen to be a relatively normal thing to say, which allows people to be honest and pick extremes. Questions also tend to be less ‘situation’ and more ‘specific’, where you can very clearly visualize what you’d be doing in that situation, rather than responding “Oh… sometimes I am, sometimes I’m not!” (E.g. “I am quiet” likely wouldn’t follow this trend, but “I am quiet around strangers” does because the question narrow down the situation. You also don’t really change your behavior around different strangers - it’s pretty consistent.)

Some other examples include:

If you’re wondering which side they skew on…. just trust your gut on it :)

  1. Skewed (Second Row)

i feel like these are best associated with questions where self-bias is most prevalent, as you want to make yourself as something you’re not (to make yourself feel better). These questions are also very situational; Sometimes I do this, sometimes I do. That’s why people tend to move towards the middle. This is the most common distribution type.

Examples include:

  1. “Normal” Distribution (Third Row, Left)

I’m lying to you - This graph isn’t normal distribution. I’m just calling it normal distribution because the answer 3 (neutral) is the most common answer. Quite frankly, it just means that people are either confused or they don’t really have a large opinion on it, so they’re almost forced to choose 3. These questions seem to be the most ‘observable/objective’ of the bunch. Personally, I try to make a habit on avoiding clicking 3 no matter what (I’m not sure if others are the same), but it’s still interesting to see. I feel like these things are not things to be ‘proud’ of or dislike about yourself, nor would you mention it unless prompted, which is likely why it’s typically associated with the extrovertism questions.

Examples Include:

  1. Relatively Random (Third Row, Right)

So these are the ones that don’t follow any of the trends above. Well, what happens is that 1 and 5 are similar in height and have about 150k responses, while 3, 4, 5 are also similar in height, with about 250k responses. Basically, the columns are relatively the same. It’s the kinds of questions that go “Yea… I’m definitely not SUPER ___, but it happens from time to time… I’m not sure how I would compare with other people though… so 2, 3, or 4 sound about right.”

Examples Include:


  1. Recall how introverted questions are negatively keyed and subtracted from your total.↩︎

  2. The average values will actually shift every time I update the website (on RStudio!), as the function ‘slice_sample’ will grab the average of 100 randomly selected responses, resulting in a unique average every time!↩︎

  3. https://www.wbur.org/hereandnow/2022/07/13/stress-survey-gallup↩︎

  4. https://www.voanews.com/a/why-people-worldwide-are-unhappier-more-stressed-than-ever-/6658784.html↩︎

  5. If someone told you, “Yea, you’re just a bit egocentric… no offense”, would you be happy about it?↩︎

  6. This was the only site that had theoretical values. I don’t know where they got their percentages from, and there was also no data on certain combinations. It should also be noted that this site does not use ‘X’ as a possible result. E.g. XLUEI (or any combination with an ‘X’) is not considered. So this source can not be completely trusted. It should also be noted that SimilarMinds separates the theoretical values by female and male. Since this data set does not have this distinction, I used the average of the male and female theoretical values to get my average number.↩︎

  7. Extroverted, stable, organized, agreeable, and inquisitive are all attributes that allow people to thrive, as they will tend to have larger social circles, better intrapersonal relationships and private lives, and the ability to study and work hard to get to positions they want academically and corporately.↩︎

  8. If you have more ideas, I’d love to hear them! Reach out :)↩︎

  9. There’s actually 3794 people who got XXXXX in this data set↩︎

  10. ‘Country codes’ are kinda misleading. There are ~195 countries, and ISO has 249 different codes. This is because the ISO contains subdivisions of countries, e.g. Caymen Islands (UK) and Christmas Island (Australia)↩︎

  11. https://www.searchenginejournal.com/ranking-factors/physical-proximity-to-searcher↩︎

  12. I couldn’t find any location data on the website itself↩︎

  13. As a Canadian, it’s actually the third search result!↩︎

  14. e.g. the 996 schedule of working from 9am to 9pm, 6 days a week↩︎

  15. Youth in China are adopting the philosophy of ‘lying down’ and giving up, due to the bad job market after graduation. They often feel let down by their society, as they’ve always been taught that studying hard and getting into a good university will lead to a good life. Yet, when they graduate, they struggle to find jobs and keep themselves afloat.↩︎

  16. E.g. To get into university, students take the Gaokao, a two-day standardized test that determines their entire future.↩︎

  17. I actually forgot this type of graph existed, until I was randomly scrolling through the ggplot2 library of different graph types!↩︎

  18. as they’re significant outliars↩︎

  19. 500 is enough to show the general trend, and utilizing more only makes graphs take longer to load.↩︎

  20. I.e. If you ask people to choose a number between 1 and 5, they tend to pick 2, 3, or 4, rather than 1 or 5.↩︎

  21. This one is almost inverted, where 2 and 4 are the most common responses, followed by 1 and 5, then 3.↩︎